© Statistical Detection of Atypical Aircraft Flights 

A priori specification of search criteria is not necessary. 
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A computational method and soft- 
ware to implement the method have 
been developed to sift through vast 
quantities of digital flight data to alert 
human analysts to aircraft flights that 
are statistically atypical in ways that sig- 
nify that safety may be adversely af- 
fected. On a typical day, there are tens 
of thousands of flights in the United 
States and several times that number 
throughout the world. Depending on 
the specific aircraft design, the volume 
of data collected by sensors and flight 
recorders can range from a few dozen 
to several thousand parameters per sec- 
ond during a flight. Whereas these data 
have long been utilized in investigating 
crashes, the present method is oriented 
toward helping to prevent crashes by 
enabling routine monitoring of flight 
operations to identify portions of flights 
that may be of interest with respect to 
safety issues. 

Experience has taught that statisti- 
cally atypical flights often pose safety is- 
sues. Conventional methods of Finding 
anomalous flights in bodies of digital 
flight data require users to pre-define 
the operational patterns that constitute 
unwanted performances. Typically, for 
example, a program examines flight 
data for exceedences (e.g., instances of 
excessive speed, excessive acceleration, 
and other parameters outside normal 
ranges). In other words, a conventional 
flight-data-analysis computer program 
Finds only the patterns it is told to seek 


in flight data, and is blind to newly 
emergent patterns that it has not been 
told to seek. The present method over- 
comes this deficiency in that it does not 
require any pre-specification of what to 
look for in bodies of flight data. The 
method is based partly on the principle 
that it is necessary, not only to look for 
exceedences, but to go beyond excee- 
dences, looking for more subtle data 
patterns that often cannot be pre- 
scribed in advance. 

The method involves a series of pro- 
cessing steps that convert the massive 
quantities of raw data, collected during 
routine flight operations, into useful in- 
formation. The raw data are progres- 
sively reduced using both deterministic 
and statistical methods. Multivariate 
cluster analysis is performed to group 
flights by similarity with respect to flight 
signatures derived from parameter val- 
ues. The process includes analysis of 
multiple selected flight parameters for 
a selected phase of a selected flight, and 
for determining when the selected 
phase of the selected flight is atypical in 
comparison with the corresponding 
phases of other, similar flights for which 
corresponding data are available. For 
each flight, there is computed an atypi- 
cality score based partly on results from 
the cluster analysis. The distribution of 
atypicality scores of all flights is used to 
identify flights for examination. 

The data from each day’s flights are 
processed during the night and sum- 


marized in a document, called the 
“Morning Report,” that includes a list 
of the 20 percent of flights having the 
highest atypicality scores, ranked in 
order of descending atypicality score. 
For each flight, the report includes a 
plain-language description of what 
makes the flight atypical. With the 
help of software designed to be 
intuitively useable, an analyst works 
through this list of flights to the finest 
level of detail where necessary, exam- 
ining the characteristics that made 
them atypical, assessing their opera- 
tional significance, and determining 
the need for further action. 
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White, Alan Willse, Scott Cooley, Joseph Jay, 
Loren Rosenthal, Andrea Swickard, Derrick 
Bates, Chad Scherrer, and Bobbiejo Webb of 
Battelle Memorial Institute; Robert Lawrence 
of Safe Flight; Chris Mosbrucker, Gary 
Prothero, Adi Andrei, Tim Romanowski, 
Daniel Robin, and Jason Prothero of 
ProWorks Corporation; Robert Lynch of 
Flight Safety Consultants; and Michael Loiue 
of the U.S. Navy. Further information is con- 
tained in a TSP (see page 1 ). 

This invention has been patented by NASA 
(U.S. Patent No. 6,937,924). Inquiries con- 
cerning rights for the commercial use of this 
invention should be addressed to the Ames 
Technology Partnerships Division at (650) 
604-2954. Refer to ARC-15041-1 


© NASA’s Aviation Safety and Modeling Project 

Capabilities for automated analysis of flight data are under development. 
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The Aviation Safety Monitoring and 
Modeling (ASMM) Project of NASA’s 
Aviation Safety program is cultivating 
sources of data and developing auto- 
mated computer hardware and software 
to facilitate efficient, comprehensive, 
and accurate analyses of the data col- 
lected from large, heterogeneous data- 
bases throughout the national aviation 
system. The ASMM addresses the need 
to provide means for increasing safety by 
enabling the identification and correct- 


ing of predisposing conditions that 
could lead to accidents or to incidents 
that pose aviation risks. 

A major component of the ASMM 
Project is the Aviation Performance 
Measuring System (APMS) , which is de- 
veloping the next generation of soft- 
ware tools for analyzing and interpret- 
ing flight data (see figure). Airlines, 
military units, corporate operators, and 
others analyze aircraft flight data 
to identify contributing factors and 


corrective actions for situations in 
which aircraft performance parameters 
exceed normal limits during phases of 
flight. The programs for performing 
such exceedance-based analyses are de- 
noted flight operations quality assur- 
ance (FOQA in civilian settings) pro- 
grams and take their inspiration from 
statistical process control. However, 
FOQA analysis involves use of only a 
portion of the data: large quantities of 
data are scanned to extract and under- 
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